Python Job: Data Engineer

Job added on

Company

Numerator

Location

New York - India

Job type

Full-Time

Python Job Details

How You’ll Spend Your Time

  • Develop expertise in the different upstream data stores and systems across Numerator.
  • Design, develop and maintain data integration pipelines for Numerators growing data sets and product offerings.
  • Build testing and QA plans for data pipelines.
  • Build data validation testing frameworks to ensure high data quality and integrity.
  • Write and maintain documentation on data pipelines and schemas
  • Bachelor's/Master’s Degree or Diploma in Computer Science or equivalent technical qualification with 4+ years of experience in relevant role
  • Expert in RDBMS(preferably in SQL,Postgres,Snowflake) including advanced analytical queries
  • Proficiency in Python (data structures, algorithms, object oriented programming, using API’s)
  • Experience building and monitoring Airflow DAGs, developing custom operators, using script templating solutions.
  • Experience with ETL processes,schema design and data modeling
  • Experience or knowledge on cloud tech (AWS and\or Azure)
  • Experience with Terraform, Docker and/or CircleCI is a bonus
  • Participate in daily scrum stand-up calls and sprint retrospectives

Soft Skills

  • Ability to work in a team and Independent.
  • Quick learner and excellent team player.
  • Excellent Communication Skills (Oral and Written)
  • Ad Intel is a large domain, so you must be curious of the unknown and a self starter.
  • Critical thinker and problem-solving skills
  • Good time-management skills
  • Well versed with Jira, confluence, Slack, Google Chat and Drive

#LI-REMOTE

#EBI

#LI-TM1